Devices and methods for bridging video information over an extension medium

ABSTRACT

In some embodiments, an upstream facing port device (UFP device) is connected to a DisplayPort source device via a connection that complies with the DisplayPort specifications. A downstream facing port device (DFP device) is connected to a DisplayPort sink device via a connection that complies with the DisplayPort specifications. The UFP device and the DFP device are connected via an extension medium to allow the DisplayPort source device to provide video and/or audio for presentation by the DisplayPort sink device. In some embodiments, the UFP device and/or the DFP device may be configured to provide video extracted from the DisplayPort communication to an external video processing device for processing before and/or after transmission over the extension medium.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of application Ser. No. 15/351,122,filed Nov. 14, 2016, the entire disclosure of which is herebyincorporated by reference herein for all purposes.

BACKGROUND

DisplayPort communication is described in detail at least in “VESADisplayPort Standard, Version 1.4,” released on Mar. 1, 2016, by VESA.This document, the content of which is known to one of ordinary skill inthe art, is hereby incorporated by reference herein in its entirety,along with any earlier versions or related documents mentioned therein(collectively hereinafter “the DisplayPort specification”), for allpurposes. The DisplayPort specification describes physical and logicaltechniques for communication between a DisplayPort source device whichgenerates video (and, in some embodiments, audio) and a DisplayPort sinkdevice which presents the video (and, in some embodiments, audio). TheDisplayPort specification also describes topologies wherein one or morebranch devices (which are similar to repeaters, splitters, or hubs) arepresent between the DisplayPort source device and the DisplayPort sinkdevice.

The DisplayPort specification includes some limits on the length of acable connecting the DisplayPort source device and the DisplayPort sinkdevice, and also includes other specific requirements for the physicalconstruction of the cable. For example, full bandwidth transmission overa passive cable is limited to a cable length of three meters. Further,the DisplayPort specification describes direct communication between theDisplayPort source device and the DisplayPort sink device, but does notallow any manipulation of the video or audio content between theDisplayPort source device and the DisplayPort sink device.

What is desired are devices and techniques that allow DisplayPort sourceand sink devices that otherwise comply with the DisplayPortspecifications to communicate over an extension medium despite thetransmission distance limits and media requirements of the DisplayPortspecifications. It is also desired to provide devices and techniquesthat allow manipulation of the video or audio content between theDisplayPort source device and the DisplayPort sink device in a mannerthat is transparent to the DisplayPort source device and the DisplayPortsink device.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to identify key features ofthe claimed subject matter, nor is it intended to be used as an aid indetermining the scope of the claimed subject matter.

In some embodiments, an upstream facing port device (UFP device) isprovided. The UFP device comprises a DisplayPort interface configured tobe coupled to a DisplayPort source device; an extension interfaceconfigured to be coupled to an extension medium; an upstream videoengine configured to receive DisplayPort information from theDisplayPort interface; and an upstream AUX engine. The upstream AUXengine is configured to disable a hot plug detect (HPD) signal frombeing transmitted by the DisplayPort interface to the DisplayPort sourcedevice; receive, via the extension interface, a notification from adownstream facing port device indicating a link training result betweenthe downstream facing port device and a DisplayPort sink device; and, inresponse to receiving the notification: enable the HPD signaltransmission by the DisplayPort interface to the DisplayPort sourcedevice; and cause the upstream video engine to conduct link trainingwith the DisplayPort source device based on the link training resultfrom the downstream facing port device.

In some embodiments, a downstream facing port device (DFP device) isprovided. The DFP device comprises a DisplayPort interface configured tobe coupled to a DisplayPort sink device; an extension interfaceconfigured to be coupled to an extension medium; a downstream videoengine configured to provide DisplayPort information to the DisplayPortsink device; and a downstream AUX engine. The downstream AUX engine isconfigured to cause the downstream video engine to conduct link trainingwith the DisplayPort sink device; receive information regarding linktraining results from the downstream video processing engine; cause thedownstream video engine to transmit placeholder video signals to theDisplayPort sink device; transmit the information regarding the linktraining results to an upstream facing port device via the extensioninterface; and, in response to receiving incoming video signals from theupstream facing port device via the extension interface, cause thedownstream video engine to transmit video from the incoming videosignals to the DisplayPort sink device.

In some embodiments, a method for establishing DisplayPort communicationbetween a DisplayPort source device and a DisplayPort sink device overan extension medium via an upstream facing port device (UFP device) anda downstream facing port device (DFP device) is provided. The DFP deviceconducts link training between the DFP device and the DisplayPort sinkdevice. The DFP device transmits a link training result to the UFPdevice. In response to receiving the link training result, the UFPdevice conducts link training between the UFP device and the DisplayPortsource device based on the link training result.

DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of thisinvention will become more readily appreciated as the same become betterunderstood by reference to the following detailed description, whentaken in conjunction with the accompanying drawings, wherein:

FIGS. 1A and 1B are block diagrams that respectively illustrateexemplary embodiments of an upstream facing port device (UFP device) anda downstream facing port device (DFP device) in a first configurationaccording to various aspects of the present disclosure;

FIGS. 2A and 2B are block diagrams that respectively illustrateexemplary embodiments of a UFP device and a DFP device in a secondconfiguration according to various aspects of the present disclosure;

FIG. 3 is a block diagram that illustrates an exemplary embodiment of anupstream video engine according to various aspects of the presentdisclosure;

FIG. 4 is a block diagram that illustrates an exemplary embodiment of adownstream video engine according to various aspects of the presentdisclosure;

FIG. 5 is a block diagram that illustrates an exemplary embodiment of anextension interface engine according to various aspects of the presentdisclosure; and

FIGS. 6A-6B are a flowchart that illustrates an exemplary embodiment ofa method of establishing DisplayPort communication between a sourcedevice and a sink device via an extension medium according to variousaspects of the present disclosure.

DETAILED DESCRIPTION

In some embodiments of the present disclosure, an upstream facing portdevice (UFP device) is connected to a DisplayPort source device via aconnection that complies with the DisplayPort specifications. Adownstream facing port device (DFP device) is connected to a DisplayPortsink device via a connection that complies with the DisplayPortspecifications. The UFP device and the DFP device are connected via anextension medium to allow the DisplayPort source device to provide videoand/or audio for presentation by the DisplayPort sink device. In someembodiments, the UFP device and/or the DFP device may be configured toprovide video extracted from the DisplayPort communication to anexternal video processing device for processing before or aftertransmission over the extension medium. In some embodiments, theconnection between the UFP device and the DisplayPort source device,and/or the connection between the DFP device and the DisplayPort sinkdevice, may pass through one or more DisplayPort branch devices.

FIGS. 1A and 1B are block diagrams that respectively illustrateexemplary embodiments of an upstream facing port device (UFP device) anda downstream facing port device (DFP device) in a first configurationaccording to various aspects of the present disclosure. In FIG. 1A, aDisplayPort source device 102, an upstream facing port device (UFPdevice) 104, and an extension medium 90 are illustrated. The DisplayPortsource device 102 may be any type of device having a DisplayPortreceptacle and capable of transmitting DisplayPort information,including but not limited to a desktop computing device, a laptopcomputing device, a tablet computing device, a rack-mount computingdevice, an external graphics card, a video processing system, and/or thelike. The DisplayPort source device 102 includes a DisplayPort interface110, which is communicatively coupled to a DisplayPort interface 112 ofthe UFP device 104. The connection between the DisplayPort source device102 and the UFP device 104 via the DisplayPort interfaces 110, 112includes standard DisplayPort receptacles, a DisplayPort cable, and thelike, as described in the DisplayPort specifications and as known to oneof ordinary skill in the art. In some embodiments, the DisplayPortinterfaces 110, 112 may include one or more of a DisplayPort connector,a USB Type-C connector, and/or a DockPort connector.

The UFP device 104 includes an upstream processor 114. In someembodiments, the upstream processor 114 may be implemented using afield-programmable gate array (FPGA), an application-specific integratedcircuit (ASIC), a microcontroller, and/or any other suitable type ofcomputing device or integrated circuit. The upstream processor 114 isconfigured to provide an upstream video engine 120 and an upstream AUXengine 122. In general, the word “engine,” as used herein, refers tologic embodied in hardware, or software instructions which can bewritten in a programming language, such as C, C++, COBOL, JAVA™, PHP,Perl, HTML, CSS, JavaScript, VBScript, ASPX, Microsoft .NET™, and/or thelike. An engine embodied in hardware may be designed using a hardwaredescription language (HDL). A software engine may be compiled intoexecutable programs or written in interpreted programming languages.Engines may be callable from other engines or from themselves.Generally, the engines described herein refer to logical modules thatcan be merged with other engines, or can be divided into sub-engines.The engines can be stored in any type of computer-readable medium orcomputer storage device and be stored on and executed by one or moregeneral purpose computers, thus creating a special purpose computerconfigured to provide the engine or application. The engines may also beimplemented using a floating point gate array (FPGA), anapplication-specific integrated circuit (ASIC), a microcontroller, orany other suitable type of integrated circuit computing device.

In some embodiments, the upstream video engine 120 is configured toreceive one or more DisplayPort lanes from the DisplayPort interface112. The upstream video engine 120 is configured to recover the videoand/or audio signals from the DisplayPort lanes, and to provide thevideo and/or audio signals to the extension interface 116. In someembodiments, the upstream video engine 120 may configurably performfurther processing on the video and/or audio before providing it to theextension interface 116, including but not limited to changing a bitrate of the information, encrypting the information, upsampling ordownsampling the information, and/or any other type of processing. Insome embodiments, the upstream video engine 120 is also configured toselectively provide a hot plug detect (HPD) signal to the DisplayPortsource device 102 via the DisplayPort interface 112. The upstream videoengine 120 may selectively provide the HPD signal based on instructionsreceived from the upstream AUX engine 122 or other components of the UFPdevice 104. Further illustration and description of an exemplaryembodiment of an upstream video engine 120 is provided in FIG. 3 and theaccompanying text.

In some embodiments, the upstream AUX engine 122 is configured to manageAUX channel communication with the DisplayPort source device and tocontrol the selective presentation of the HPD signal by the upstreamvideo engine 120. One of the technical challenges of extendingDisplayPort communication across the extension medium 90 is that the UFPdevice 104 may be unaware of the presence, configuration, orcapabilities of the DFP device 106 or the DisplayPort sink device 108upon connection of the DisplayPort source device 102 to the DisplayPortinterface 112. Accordingly, the upstream AUX engine 122 manipulates theinformation communicated via the AUX channel and the HPD signal in orderto overcome these challenges. The upstream AUX engine 122 and theupstream video engine 120 may also be configured to conduct linktraining with the DisplayPort source device 102. Further detailsregarding some example techniques used by the upstream AUX engine 122and the upstream video engine 120 to provide this functionality areprovided below.

In some embodiments, the upstream video engine 120 and the upstream AUXengine 122 communicate video/audio and AUX information with the DFPdevice 106 over the extension medium 90 via an extension interface 116.In some embodiments, the extension medium 90 and communication thereonmay include any suitable networking technology, such as Ethernet,Bluetooth, WiFi, WiMax, the Internet, serial communication, and/or thelike, and any suitable communication medium, such as via physicalcables, via wireless spectrum, via fiber-optic cable, and/or the like.In some embodiments, the UFP device 104 and the DFP device 106 mayhappen to be closer to each other than the maximum distances specifiedin the DisplayPort specifications, but may nevertheless communicate viathe extension medium 90. In some embodiments, the extension interface116 is configured to provide a physical layer connection and logic thatallows communication over the extension medium 90. Further illustrationand description of an exemplary embodiment of an extension interface 116is provided in FIG. 5 and the accompanying text.

In some embodiments, the UFP device 104 also includes an externalinterface 115 capable of providing video, audio, and/or AUXcommunication to an external device. In the embodiment illustrated inFIG. 1A, the external interface 115 is not being used.

In FIG. 1B, a DisplayPort sink device 108, a downstream facing portdevice (DFP device), 106, and the extension medium 90 are illustrated.The DisplayPort sink device 108 may be any type of device capable ofacting as a DisplayPort sink as described in the DisplayPortspecification. Some non-limiting examples of DisplayPort sink devices108 include liquid crystal display (LCD) monitors, projectors,large-format screens, video processing systems, and/or the like. TheDisplayPort sink device 108 includes a DisplayPort interface 132, whichis communicatively coupled to a DisplayPort interface 130 of the DFPdevice 106 using a cable or other connector. As with the connectionbetween the DisplayPort source device 102 and the UFP device 104, thecable and interfaces 130, 132 include standard DisplayPort receptacles,plugs, conductors, and the like, as described in the DisplayPortspecifications and as known to one of ordinary skill in the art.

In some embodiments, the DFP device 106 includes a downstream processor128. As with the upstream processor 114, the downstream processor 128and/or its components may be implemented using an FPGA, an ASIC, amicrocontroller, and/or any other suitable type of computing device orintegrated circuit. The downstream processor 128 provides a downstreamvideo engine 136 and a downstream AUX engine 138.

In some embodiments, the downstream video engine 136 is configured toreceive video and/or audio signals from the extension interface 126, andto generate one or more DisplayPort lanes based on the video and/oraudio signals. The downstream video engine 136 is configured to providethe DisplayPort lanes to the DisplayPort sink device 108 via theDisplayPort interface 130. The downstream video engine 136 may also beconfigured to receive and detect the HPD signal transmitted by theDisplayPort sink device 108 via the DisplayPort interface 130. Furtherillustration and description of an exemplary embodiment of a downstreamvideo engine 136 is provided in FIG. 4 and the accompanying text.

In some embodiments, the downstream AUX engine 138 is configured tomanage AUX channel communication with the DisplayPort sink device 108,and may be configured to negotiate capabilities with the upstream AUXengine 122 such that the upstream AUX engine 122 can report capabilitiesto the DisplayPort host device 102 that match the capabilities of theDisplayPort sink device 108 (or other capabilities as selectivelyconfigured). The downstream AUX engine 138 and the downstream videoengine 136 may also be configured to conduct link training with theDisplayPort sink device 108. Further details regarding some exampletechniques used by the downstream AUX engine 138 and the downstreamvideo engine 136 to provide this functionality are provided below.

In some embodiments, the downstream video engine 136 and the downstreamAUX engine 138 communicate with the upstream video engine 120 and theupstream AUX engine 122 via the extension medium 90 using the extensioninterface 126. The extension medium was described above, and theextension interface 126 is also similar to the extension interface 116illustrated in FIG. 1A (though operating in reverse). Furtherillustration and description of an exemplary embodiment of an extensioninterface 126 is provided in FIG. 5 and the accompanying text.

FIGS. 2A and 2B are block diagrams that respectively illustrateexemplary embodiments of a UFP device and a DFP device in a secondconfiguration according to various aspects of the present disclosure. InFIG. 2A, a UFP device 104, a DisplayPort source device 102, and anextension medium 90 are illustrated. The UFP device 104, the DisplayPortsource device 102, and the extension medium 90 are similar to thosediscussed in FIG. 1A, and so a full description of all components is notprovided for the sake of brevity.

One way in which the UFP device 104 illustrated in FIG. 2A is differentfrom the UFP device 104 illustrated in FIG. 1A is that it is connectedvia the interface 115 to an upstream external video processing device118. The interface 115 may be connected to a complementary interface onthe upstream external video processing device 118, which is notillustrated for the sake of clarity. The interface 115 may be anysuitable interface for transferring video and/or audio data between theUFP device 104 and the upstream external video processing device 118,including but not limited to Ethernet, a 10-gigabit media independentinterface, a 10-gigabit attachment unit interface (XAUI), a reduced XAUI(RXAUI) interface, a high speed SERDES, and/or the like.

The upstream external video processing device 118 may be a purpose-builtgraphics processing device, a graphics card, and/or any other suitabledevice configured to receive video signals, process them into adifferent format, and output the processed video. Some non-limitingexamples of suitable devices include compression devices, overlaydevices, On-screen Display (OSD) devices, and scaler devices. In someembodiments, the upstream external video processing device 118 includesan external video processing engine 124 that performs the videoprocessing. The upstream external video processing device 118 isreferred to as “upstream” for the clarity of the description, because itis attached to the UFP device 104. The external video processing engine124 is referred to as “external” because it is external from the UFPdevice 104, the DFP device 106, the DisplayPort source device 102, andthe DisplayPort sink device 108. The ability to seamlessly provide thevideo and/or audio that was transmitted from the DisplayPort sourcedevice 102 for external processing allows different interchangeablevideo processing devices 118 to be used with a given UFP device 104,such as if different processing capabilities are desired. It also allowsthe UFP device 104 to provide extension capabilities to anon-extension-enabled video processing device 118.

In the embodiment illustrated in FIG. 2A, the upstream video engine 120receives one or more lanes of DisplayPort data, and extracts theoriginal video and/or audio information from the lanes. Instead oftransmitting the video and/or audio to the extension interface 116, theupstream video engine 120 provides the video to the upstream externalvideo processing device 118 via the interface 115. The upstream externalvideo processing device 118 then processes the unprocessed video tocreate processed video. In some embodiments, digital video may beprovided to the upstream external video processing device 118 in anysuitable format.

In some embodiments, the upstream external video processing device 118may provide the processed video directly to the extension medium 90. Forexample, the upstream external video processing device 118 may itselfhave an Ethernet interface, and so may be capable of transmitting theprocessed video directly to the DFP device 106 or the downstreamexternal video processing device 134 via the extension medium 90. Insome embodiments, the upstream external video processing device 118 mayprovide the processed video back to the interface 115, so that theprocessed video may be transmitted to the DFP device 106 or thedownstream external video processing device 134 via the extensioninterface 116.

In some embodiments, the upstream external video processing device 118may also contribute to the AUX communication via the interface 115. Insuch embodiments, the upstream external video processing device 118 maycommunicate with the upstream AUX engine 122 to provide additionalcapabilities to the DisplayPort source device 102 that can be supportedwith the assistance of the upstream external video processing device118, or to limit the capabilities advertised to the DisplayPort sourcedevice 102. In some embodiments, the upstream external video processingdevice 118 may eavesdrop on the AUX channel communication between theother devices in order to properly configure itself.

In FIG. 2B, a DFP device 106, a DisplayPort sink device 108, and anextension medium 90 are illustrated. Again, the DFP device 106, theDisplayPort sink device 108, and extension medium 90 are similar tothose illustrated in FIG. 1B, and so all of the components are notdescribed again in detail to avoid repetition. The DFP device 106 isconnected via an interface 139 to a downstream external video processingdevice 134. The interface 139 is similar to the interface 115illustrated and discussed above with respect to the UFP device 104. Thedownstream external video processing device 134 could be any suitabletype of device for processing video and/or audio information, includingbut not limited to the types of devices suitable for use as the upstreamexternal video processing device 118. The downstream external videoprocessing device 134 includes an external video processing engine 140that performs the video processing. The downstream external videoprocessing device 134 is referred to as “downstream” because it isattached to the DFP device 106 as opposed to the UFP device 104, and“external” because it is separate from the DisplayPort source device102, the UFP device 104, the DFP device 106, and the DisplayPort sinkdevice 108.

As illustrated in FIG. 2B, the downstream external video processingdevice 134 receives processed video. In some embodiments, the downstreamexternal video processing device 134 receives the processed videodirectly from the extension medium 90. In some embodiments, thedownstream external video processing device 134 receives the processedvideo from the DFP device 106 via the interface 139. Once received, theexternal video processing engine 140 re-processes the processed video tocreate de-processed video, which it then outputs to the DFP device 106via the interface 139. The downstream video engine 136 receives thede-processed video, and creates one or more DisplayPort lanes thatinclude the de-processed video. In some embodiments, digital video maybe provided to and from the downstream external video processing device134 in any suitable format. Similar to the discussion above, thedownstream external video processing device 134 can contribute to theAUX channel communication via the interface to either provide additionalcapabilities, limit the advertised capabilities, or configure itselfbased on the result of link training between the DFP device and theDisplayPort sink device 108.

In some embodiments (such as the embodiments illustrated in FIGS.2A-2B), the upstream external video processing device 118 and thedownstream external video processing device 134 may be paired devicesthat perform complimentary processing. As described, the upstreamexternal video processing device 118 may process the video for moreefficient transmission over the extension medium 90 (such as reducing abit rate via a lossless compression algorithm such as H.264 losslesscompression and/or the like), and the downstream external videoprocessing device 134 may generate de-processed video by decompressingthe received processed video. In some embodiments, the processingperformed by the upstream external video processing device 118 to createprocessed video may include encrypting the video using any suitablealgorithm, including but not limited to DES, AES, and RSA, and theprocessing performed by the downstream external video processing device134 may include decrypting the processed video to create thede-processed video. In some embodiments, the upstream external videoprocessing device 118 and the downstream external video processingdevice 134 may collaborate to support HDCP encryption, decryption,and/or verification. In some embodiments, processing may include anytype of two-dimensional or three-dimensional video processing, includingbut not limited to overlay, underlay, scaling, reformatting, andcompression. In some embodiments, the upstream external video processingdevice 118 and the downstream external video processing device 134 mayperform different types of processing. For example, the upstreamexternal video processing device 118 may change a frame rate of thevideo information, and the downstream external video processing device134 may zoom a region of interest in the video information. In someembodiments, only one of the upstream external video processing device118 and the downstream external video processing device 134 may bepresent.

FIG. 3 is a block diagram that illustrates an exemplary embodiment of anupstream video engine according to various aspects of the presentdisclosure. As illustrated, the upstream video engine 120 includes aSERDES engine 302, a decoding engine 304, and a descrambling engine 306.The SERDES engine 302, or serializer/deserializer engine, is configuredto deserialize parallel data streams that have been received via theDisplayPort interface 112 in a serial format. The received data streamsmay include one or more scrambled and encoded video data streams. Thereceived signals may also include AUX channel data, audio data, and/orother types of data.

The decoding engine 304 is configured to decode the encoded signalsreceived from the SERDES engine 302. The decoding algorithm to be usedmay be specified via AUX channel communication, such that the decodingengine 304 can be configured to use a decoding technique that matchesthe incoming data. Some non-limiting examples of encoding formatsinclude 8b/10b encoding, Display Stream Compression (DSC) encoding, andthe like. The descrambling engine 306 is configured to descramble thedecoded video signals generated by the decoding engine 304. Techniquesfor descrambling are described in the DisplayPort specifications. Theoutput of the descrambling engine 306 (and therefore the upstream videoengine 120) is a video signal suitable for presentation by a videopresentation device or suitable for further video processing. An H.264stream is one non-limiting example of the output, though other suitablevideo formats may be used. In some embodiments, the output of theupstream video engine 120 may include audio information and/or AUXchannel information as well.

In some embodiments, the illustrated components of the upstream videoengine 120 may be combined with each other, or individual components maybe split into multiple components. Some other example componentssuitable for use in the upstream video engine 120 are described in thedescriptions in the DisplayPort specifications of components forproviding a main link.

FIG. 4 is a block diagram that illustrates an exemplary embodiment of adownstream video engine according to various aspects of the presentdisclosure. In some embodiments, the downstream video engine 136provides the inverse of the functionality of the upstream video engine136. That is, the downstream video engine 136 may video and audiosignals suitable for presentation, and transmits DisplayPort data. Asillustrated, the downstream video engine 136 includes a scramblingengine 402, an encoding engine 404, and a SERDES engine 406. Thescrambling engine 402 receives the video and/or audio signals andscrambles them using any suitable technique, including but not limitedto the techniques described in the DisplayPort specification. Theencoding engine 404 receives the scrambled video and/or audio signalsfrom the scrambling engine 402 and encodes them using any suitabletechnique, including but not limited to 8b/10b encoding, DSC encoding,and/or the like. The SERDES engine 406 then joins multiple scrambled andencoded data streams into a single serialized signal for transmission.As with the components of the upstream video engine 120, the componentsof the downstream video engine 136 may be combined or split apart, andboth the functionality and the structure are similar to the main linkdescribed in the DisplayPort specifications.

FIG. 5 is a block diagram that illustrates an exemplary embodiment of anextension interface engine according to various aspects of the presentdisclosure. A primary purpose of the extension interface engine 500,when on the UFP device 104, is to transmit the video, audio, and/or AUXsignals over the extension medium 90 in an extension format. When on theDFP device 106, a primary purpose of the extension interface engine 500is to receive extension format information from the extension medium 90and converts it back into the original video, audio, and/or AUX signals.The extension interface engine 500 may also communicate informationbi-directionally, and may be used for conducting a connection handshakebetween the UFP device 104 and the DFP device 106.

As illustrated, the extension interface engine 500 includes amultiplexing engine 502, a framing engine 504, a media access control(MAC) engine 506, a 10-gigabit media-independent interface (XGMII)engine 508, an XGMII extender sublayer (XGXS) engine 510, and a SERDESengine 512. Obtaining, implementing, and/or integrating each of thesecomponents with each other to form the extension interface engine 500 iswithin the knowledge of one of ordinary skill in the art, and so is notdescribed in detail. The extension interface engine 500 as illustratedis configured to use gigabit Ethernet as the extension medium 90. Insome embodiments, a different extension medium 90 may be used, and sothe components of the extension interface engine 500 would be selectedas appropriate for use with the different extension medium.

FIGS. 6A-6B are a flowchart that illustrates an exemplary embodiment ofa method of establishing DisplayPort communication between a sourcedevice and a sink device via an extension medium according to variousaspects of the present disclosure. From a start block, the method 600proceeds to block 602, where a physical connection is made between aDisplayPort (DP) source device 102 and an upstream facing port device(UFP device) 104. The physical connection between the DisplayPort sourcedevice 102 and the UFP device 104 may be substantially as described inthe DisplayPort specifications. At block 604, the UFP device 104withholds a hot plug detect (HPD) signal from the DP source device 102.This behavior contradicts the behavior expected under the DisplayPortspecifications. Normally, the HPD signal would be presented by aDisplayPort sink upon connection to a DisplayPort source. However,technical problems are created by the introduction of the extensionmedium 90, in that the UFP device 104 may be connected to theDisplayPort source device 102 before a handshake has been performedbetween the UFP device 104 and the DFP device 106, and beforecapabilities of the DisplayPort sink device 108 are known to the UFPdevice 104. This could cause the DisplayPort source device 102 to try(and fail) to train the DisplayPort link with the UFP device 104.Withholding the HPD signal keeps the DisplayPort source device 102 fromrealizing that anything is connected, and so prevents the DisplayPortsource device 102 from trying to train a DisplayPort link until the UFPdevice 104 is ready to do so.

At block 606, a physical connection is made between a DisplayPort sinkdevice 108 and a downstream facing port device (DFP device) 106. Similarto above-described connection, the physical connection between theDisplayPort sink device 108 and the DFP device 106 substantiallycomplies with the DisplayPort specifications. The DisplayPort sinkdevice 108 may begin presenting an HPD signal to the DFP device 106 atthis point, but the DFP device 106 ignores the signal until it is ready.

At block 608, the UFP device 104 and the DFP device 106 form aconnection via an extension medium 90. The connection may be formedusing any suitable technique. As one example, the UFP device 104 and theDFP device 106 may exchange a presence notification and anacknowledgement. As another example, forming the connection may includeconfiguring the UFP device 104 and the DFP device 106 with a uniqueidentifier of the opposite device, such as an IP address, a MAC address,and/or the like, in order to facilitate communication between theintended devices if the extension medium 90 is a network on whichmultiple devices may be present (as opposed to a point-to-pointconnection). Forming the connection between the UFP device 104 and theDFP device 106 may include exchanging capabilities of the devices anddetermining what features will be available. The connection formed inblock 608 may happen either before or after the actions described inblocks 602-606.

The method 600 then proceeds to block 610, where a downstream AUX engine138 of the DFP device 106 determines capabilities of the DisplayPortsink device 108 by retrieving information from the DisplayPort sinkdevice 108. The information describes the capabilities of theDisplayPort sink device 108, and may be any suitable type of informationincluding but not limited to DisplayPort Configuration data (DPCD),extended display identification data (EDID), and Monitor Control CommandSet (MCCS) data. The information is obtained from the DisplayPort sinkdevice 108 using a standard protocol. The information may includeinformation about the supported capabilities of the DisplayPort sinkdevice 108, such as (but not limited to) screen resolutions, bit depths,frame rates, numbers of DisplayPort lanes, and/or the like. At optionalblock 612, the downstream AUX engine 138 transmits the information to adownstream external video processing device 134 and receives anotification of updated information from the downstream external videoprocessing device 134. The information is provided to the downstreamexternal video processing device 134 in order to allow the downstreamexternal video processing device 134 to affect the capabilitieseventually presented to the DisplayPort source device 102 in order toaccount for the functionality of the downstream external videoprocessing device 134. As one example, the downstream external videoprocessing device 134 could alter the information to indicate supportfor higher resolutions than those supported by the DisplayPort sinkdevice 108 so that higher quality video is transmitted by the host. Thedownstream external video processing device 134 could then downsamplethe video, extract a region of interest, or otherwise provide video thatthe DisplayPort sink device 108 could handle. As another example, thedownstream external video processing device 134 could change theinformation to indicate support for lower resolutions only, in order tomanage bandwidth on the extension medium 90. The actions of block 612are described as optional because the downstream external videoprocessing device 134 may not be present, or may not alter theinformation (though it may nevertheless store the information receivedfrom the DFP device 106.

Next, at block 614, the downstream AUX engine 138 and a downstream videoengine 136 of the DFP device 106 conduct link training with the DP sinkdevice 108. At this point, the DFP device is essentially masquerading asor emulating a DisplayPort source in order to configure the DisplayPortsink device 108 and determine the capabilities of the link between theDFP device 106 and the DisplayPort sink device 108. In some embodiments,this link training is performed before any video information istransmitted between the DFP device 108 and the UFP device 106. Exemplaryprocesses for link training are described in the DisplayPortspecifications.

At block 616, the downstream video engine 136 provides a placeholdervideo feed to the DisplayPort sink device 108. The placeholder videofeed maintains the trained link between the DFP device 106 and theDisplayPort sink device 108, even in the absence of video informationfrom the DisplayPort source device 102. The placeholder video feed mayinclude a blank video or all-black video; a static splash screen orscreen saver; or any other suitable video and/or audio signal generatedby the DFP device 106. The method 600 then proceeds to a continuationterminal (“terminal A”).

From terminal A (FIG. 6B), the method 600 proceeds to block 618, wherethe downstream AUX engine 138 transmits information and link traininginformation to an upstream AUX engine 122 of the UFP device 104. Thelink training information indicates the configuration of the trainedlink between the DFP device 106 and the DisplayPort sink device 108. Theinformation may be the information received from the DisplayPort sinkdevice 108, the information as altered by the downstream external videoprocessing device 134, or both. The downstream AUX engine 138 maytransmit the information to the upstream AUX engine 122 over theextension medium 90 via any suitable protocol and/or technique.

At optional block 620, the upstream AUX engine 122 transmits theinformation and link training information to an upstream external videoprocessing device 118 and receives a notification of updated informationfrom the upstream external video processing device 118. Similar to thedescription above relating to the downstream external video processingdevice 134, the upstream external video processing device 118 may raiseor lower bandwidth or resolution capabilities to enable the videoprocessing functionality provided by the upstream external videoprocessing device 118. The actions of block 620 are described asoptional because the upstream external video processing device 118 maynot be present and/or because the upstream external video processingdevice 118 may not make any changes to the information.

At block 622, the UFP device 104 transmits the HPD signal to the DPsource device 102. The DisplayPort source device 102 can then detect theconnection of the UFP device 104, and begins trying to establish aDisplayPort connection. Accordingly, at block 624, the UFP device 104and the DisplayPort source device 102 conduct link training between theUFP device 104 and the DisplayPort source device 102. The UFP device 104trains the link using capabilities based on the information eitherreceived from the DFP device 106 or from the upstream external videoprocessing device 118. The UFP device 104 may use the receivedinformation as maximum or minimum supported capabilities. In someembodiments, the aim may be to train the link between the DisplayPortsource device 102 and the UFP device 104 to have the samecharacteristics as the link trained between the DFP device 106 and theDisplayPort sink device 108. In some embodiments, the aim may be totrain the link between the DisplayPort source device 102 and the UFPdevice 104 such that the DisplayPort source device 102 outputs a videostream having characteristics requested by the upstream external videoprocessing device 118 or the downstream external video processing device134.

The method 600 then proceeds to a decision block 626, where a test isperformed to determine whether the link trained between the DisplayPortsource device 102 and the UFP device 104 has capabilities that match thelink trained between the DFP device 106 and the DisplayPort sink device108. In some embodiments, matching may include links that have identicalcapabilities. In some embodiments, matching may include the link betweenthe DisplayPort source device 102 and the UFP device 104 carrying atleast enough information to saturate the link between the DFP device 106and the DisplayPort sink device 108, with the exact up conversion ordown conversion to the characteristics supported by the link to theDisplayPort sink device 108 performed by the upstream video engine 120,the downstream video engine 136, the upstream external video processingdevice 118, or the downstream external video processing device 134.

If the result of the test at decision block 626 is YES, then the method600 proceeds to a continuation terminal (“terminal B”). Otherwise, ifthe result of the test at decision block 626 is NO, then the method 600proceeds to block 628, where the upstream AUX engine 122 transmits amessage to the downstream AUX engine 138 to cause the link between theDFP device 106 and the DisplayPort sink device 108 to be retrained. Thismay be performed, for example, in cases where the link between the DFPdevice 106 and the DisplayPort sink device 108 expects a greater amountof information than can be transmitted by the DisplayPort source device102, cases where the DisplayPort source device 102 has been configuredto operate in an alternate mode, and/or any other situation in which thelink between the DFP device 106 and the DisplayPort sink device 108 doesnot match the link needed to support the video and/or audio data to besupplied to the DisplayPort sink device. In some embodiments, the DFPdevice 106 will match its capabilities to support the upstream trainedlink in cases wherein the link is to be retrained.

The method 600 then proceeds to terminal B, and then to block 630, wherethe DP source device 102 transmits video to the DP sink device 108 viathe UFP device 104, the extension medium 90, the DFP device 106, andoptionally via the upstream external video processing device 118 and thedownstream external video processing device 134. As described above, insome embodiments the extension interfaces 116, 126 may exchange thevideo and/or audio information directly and may optionally provide it tothe upstream and downstream external video processing devices 118, 134.Also, in some embodiments, the upstream and downstream external videoprocessing devices 118, 134 may directly exchange the video and/or audioinformation via the extension medium 90. The method 600 then proceeds toan end block and terminates.

As described above, the method 600 assumes that the connection to theDisplayPort source device 102 is trained based on the capabilities ofthe DisplayPort sink device 108 (as optionally modified by the externalvideo processing devices 118, 134). However, in some embodiments, theconnection between the DisplayPort source device 102 and the UFP device104 may be trained first, and the connection between the DFP device 106and the DisplayPort sink device 108 may subsequently be trained based onthe capabilities of the trained link between the DisplayPort sourcedevice 102 and the UFP device 104 (as optionally modified by theexternal video processing devices 118, 134). In such an embodiment, theUFP device 104 would not withhold the HPD signal from the DisplayPortsource device 102 as stated in block 604, and instead the UFP device 104would present the HPD signal in order to start training the link to theDisplayPort sink device 108 based on its own capabilities. Further, insuch an embodiment, the DFP device 106 may not provide a placeholdervideo feed to the DisplayPort sink device 108 as described in block 616,but would instead not start link training with the DisplayPort sinkdevice 108 until the information regarding the capabilities of the host(or modified information) is received by the DFP device 106 from the UFPdevice 104, which may render the placeholder video feed unnecessary.

In some embodiments, the UFP device 104 may train the link with theDisplayPort source device 102 while the DFP device 106 is training thelink with the DisplayPort sink device 108, and capabilities will beexchanged between the UFP device 104 and the DFP device 106 (and one ofthe links may be re-trained to match) thereafter. In such embodiments,the UFP device 104 and the DFP device 106 may not be connected to eachother during this initial link training.

While illustrative embodiments have been illustrated and described, itwill be appreciated that various changes can be made therein withoutdeparting from the spirit and scope of the invention.

The embodiments of the invention in which an exclusive property orprivilege is claimed are defined as follows:
 1. A method for processingDisplayPort communication transmitted between a DisplayPort sourcedevice and a DisplayPort sink device over an extension medium via anupstream facing port device (UFP device) and a downstream facing portdevice (DFP device), the method comprising: receiving, by the UFPdevice, DisplayPort information from the DisplayPort source device;extracting, by the UFP device, at least one of video information andaudio information from the DisplayPort information; transmitting, by theUFP device, the at least one of video information and audio informationfor processing by an external video processing device coupled to aninterface of the UFP device; receiving, by the UFP device via theinterface of the UFP device, at least one of processed video informationand processed audio information from the upstream external videoprocessing device; and transmitting, by the UFP device via the extensionmedium, the at least one of processed video information and processedaudio information to the DFP device or to a downstream external videoprocessing device.
 2. The method of claim 1, wherein transmitting the atleast one of processed video information and processed audio informationto the DFP device or to a downstream external video processing deviceincludes transmitting the at least one of processed video informationand processed audio information to the downstream external videoprocessing device via the extension medium, and wherein the methodfurther comprises: receiving, by the DFP device via an interface of theDFP device, at least one of de-processed video information andde-processed audio information from the downstream external videoprocessing device; and transmitting, by the DFP device to theDisplayPort sink device, DisplayPort information including the at leastone of de-processed video information and de-processed audioinformation.
 3. The method of claim 1, wherein transmitting the at leastone of processed video information and processed audio information tothe DFP device or to a downstream external video processing deviceincludes transmitting the at least one of processed video informationand processed audio information to the DFP device via the extensionmedium, and wherein the method further comprises: receiving, by the DFPdevice, the at least one of processed video information and processedaudio information via the extension medium; and transmitting, by the DFPdevice via an interface of the DFP device, the at least one of processedvideo information and processed audio information to an external videoprocessing device coupled to an interface of the DFP device.
 4. Themethod of claim 3, further comprising: receiving, by the DFP device viathe interface of the DFP device, at least one of de-processed videoinformation and de-processed audio information from the downstreamexternal video processing device; and transmitting, by the DFP device tothe DisplayPort sink device, DisplayPort information including the atleast one of de-processed video information and de-processed audioinformation.
 5. The method of claim 1, wherein extracting at least oneof video information and audio information from the DisplayPortinformation includes decoding and descrambling encoded, scrambled videofrom one or more DisplayPort lanes.
 6. A method for processingDisplayPort communication transmitted between a DisplayPort sourcedevice and a DisplayPort sink device over an extension medium via anupstream facing port device (UFP device) and a downstream facing portdevice (DFP device), the method comprising: receiving, by the DFP devicevia an interface of the DFP device, at least one of de-processed videoinformation and de-processed audio information from an external videoprocessing device, wherein the external video processing device receivedat least one of processed video information and processed audioinformation via the extension medium; and transmitting, by the DFPdevice to the DisplayPort sink device, DisplayPort information includingthe at least one of de-processed video information and de-processedaudio information.
 7. The method of claim 6, wherein transmittingDisplayPort information including the at least one of de-processed videoinformation and de-processed audio information includes encoding andscrambling, by the DFP device, the de-processed video information forgenerating one or more DisplayPort lanes.
 8. A method for processingDisplayPort communication transmitted between a DisplayPort sourcedevice and a DisplayPort sink device over an extension medium via anupstream facing port device (UFP device) and a downstream facing portdevice (DFP device), the method comprising: receiving, by the DFP devicevia the extension medium, at least one of processed video informationand processed audio information; transmitting, by the DFP device via aninterface of the DFP device, the at least one of processed videoinformation and processed audio information for processing by anexternal video processing device; receiving, by the DFP device via theinterface of the DFP device, at least one of de-processed videoinformation and de-processed audio information from the external videoprocessing device; and transmitting, by the DFP device to theDisplayPort sink device, DisplayPort information including the at leastone of de-processed video information and de-processed audioinformation.
 9. The method of claim 8, wherein transmitting DisplayPortinformation including the at least one of de-processed video informationand de-processed audio information includes encoding and scrambling, bythe DFP device, the de-processed video information for generating one ormore DisplayPort lanes.